Sampling Table Configurations for the Hierarchical Poisson-Dirichlet Process
نویسندگان
چکیده
•Discrete hierarchies are ubiquitous in intelligent systems. • The Poisson-Dirichlet process (PDP ) [1] allow statistical inference and learning on discrete hierarchies, e.g., hierarchy of Dirichlet distributions. • Applications of the PDP/HPDP include but not limited to: – Topic modeling: Finding meaningful topics discussed in large set of documents. Beneficial to automatic document analysis and understanding. – Computational linguistic: For example, the n-gram model. – Computer vision. Using PDP/HPDP to do image annotation, image segmentation, scene learning, and etc. – Others: Data compression, relational modeling, etc.
منابع مشابه
The Poisson–dirichlet Distribution and Its Relatives Revisited
The Poisson-Dirichlet distribution and its marginals are studied, in particular the largest component, that is Dickman’s distribution. Size-biased sampling and the GEM distribution are considered. Ewens sampling formula and random permutations, generated by the Chinese restaurant process, are also investigated. The used methods are elementary and based on properties of the finite-dimensional Di...
متن کاملDependent Hierarchical Normalized Random Measures for Dynamic Topic Modeling
We develop dependent hierarchical normalized random measures and apply them to dynamic topic modeling. The dependency arises via superposition, subsampling and point transition on the underlying Poisson processes of these measures. The measures used include normalised generalised Gamma processes that demonstrate power law properties, unlike Dirichlet processes used previously in dynamic topic m...
متن کاملA Bayesian Review of the Poisson-Dirichlet Process
The two parameter Poisson-Dirichlet process is also known as the PitmanYor Process and related to the Chinese Restaurant Process, is a generalisation of the Dirichlet Process, and is increasingly being used for probabilistic modelling in discrete areas such as language and images. This article reviews the theory of the Poisson-Dirichlet process in terms of its consistency for estimation, the co...
متن کاملGeneralized Species Sampling Priors with Latent Beta reinforcements
Many popular Bayesian nonparametric priors can be characterized in terms of exchangeable species sampling sequences. However, in some applications, exchangeability may not be appropriate. We introduce a novel and probabilistically coherent family of non-exchangeable species sampling sequences characterized by a tractable predictive probability function with weights driven by a sequence of indep...
متن کاملA conjugate prior for discrete hierarchical loglinear models
In Bayesian analysis of multi-way contingency tables, the selection of a prior distribution for either the log-linear parameters or the cell probabilities parameters is a major challenge. In this paper, we define a flexible family of conjugate priors for the wide class of discrete hierarchical log-linear models, which includes the class of graphical models. These priors are defined as the Diaco...
متن کامل